Rényi entropy dimension of the mixture of measures

نویسندگان

  • Marek Śmieja
  • Jacek Tabor
چکیده

Rényi entropy dimension describes the rate of growth of coding cost in the process of lossy data compression in the case of exponential dependence between the code length and the cost of coding. In this paper we generalize the Csiszár estimation of the Rényi entropy dimension of the mixture of measures for the case of general probability metric space. This result determines the cost of encoding of the information which comes from the combined sources assuming its exponential growth. Our proof relies on an equivalent definition of the Rényi entropy in weighted form which allows to deal well with a calculation of the entropy of the mixture of measures.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Weighted Approach to Rényi Entropy

Rényi entropy of order α is a general measure of entropy. In this paper we derive estimations for the Rényi entropy of the mixture of sources in terms of the entropy of the single sources. These relations allow to compute the Rényi entropy dimension of arbitrary order of a mixture of measures. The key for obtaining these results is our new definition of the weighted Rényi entropy. It is shown t...

متن کامل

Characterization of Rössler and Duffing maps with Rényi entropy and generalized complexity measures

Rényi entropy and generalized complexity measures are used to describe the chaotic behaviour of dynamical systems. These measures are found to be sensitive to the fine details of the Rössler and the Duffing maps. They are good descriptors of chaotic behaviour. Periodic windows and the fractal character of the chaotic dynamics are nicely detected.

متن کامل

Simple Equations for Predicting Entropy of Ammonia-Water Mixture

This work presents a set of three simple and explicit equations as a function of temperature, pressure, and mass fraction for calculation of the entropy of the ammonia-water mixture in saturated and super heated conditions. They are intended for use in the optimization and second law efficiency of absorption processes. The equations are constructed by the least square method for curve fitting u...

متن کامل

Face recognition based on manifold learning and Rényi entropy

Though manifold learning has been successfully applied in wide areas, such as data visualization, dimension reduction and speech recognition; few researches have been done with the combination of the information theory and the geometrical learning. In this paper, we carry out a bold exploration in this field, raise a new approach on face recognition, the intrinsic α-Rényi entropy of the face im...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2012